Lecture 8 
Probability 


Dr. Noor Badshah 


Random Experiments 


> An experiment which may give different results, when 
they are repeated under same conditions. 


>Examples: Tossing a number of coins 
>Throwing number of dice 

> Match between two teams 

> Selection of team 

> Selection of any item 


> Selection of playing card from a deck (52 cards), one 
card, two cards, etc. With replacement and without 
replacement, Simultaneously selection, selection in turn. 


Outcomes: 


> Any possible result of a random experiment. 


»Sample Space (S): The set of all possible outcomes 
of a random experiment: 


> Tossing a coin: 

> Tossing two coins: 
> Tossing three coins: 
»Tossing coins: 


Examples 


»Throwing one die: 
>Throwing 2 dice: 


PIf we throw dice then. 


Examples: 
> Consider a deck of 52 cards. Two colors (Red-26, Black- 
26) 


>Types 4 (Dimonds-13 J Q K, Hearts-13 J Q K, Spades-13 J 
Q K, Club-13 J QK. 


>Drawing one card. 

> Drawing two cards simul... 

> Drawing three cards... 

>Drawing number of cards simul... 


Examples: 
» Drawing two cards in turn without replacement: 
» Drawing three cards in turn without replacement: 
» Drawing cards in turn without replacement: 
Pe 
> Drawing two cards in turn with replacement: 
» Drawing three cards in turn with replacement: 
»Drawing cards in turn with replacement: 


Event: 


>Any subset of a sample space: 
>Total happenings --[] Sample space, Favorable happenings [] Event 


>Tossing a coin: 
»Samples space is known sure event. 
> is known as impossible event 


Mutually Exclusive Events: 
>Two events and are said to ME if 


> Examples: 


Equally Likely: 


>Two events and will be equally likely, if they have 
Same chance of occurrence. 


> Examples: 


Exhaustive Events: 
e Two ME events and will be EE if 


e Examples: 


Venn’s Diagram 


e Blue color (Rectangle) [| Sample space 
e White color (Circle) [| Event 


Definitions of Probability: 


e Classical Definition: 
For an event probability of an event is denoted by and is defined as: 


e Probability of an event: 


If and 


* The Relative Frequency Definition: 


If a random experiment is performed time (large) and an event is 
observed times, then 


Number of times 
coin is tossed 


Buffon 


K. Pearson 


K. Pearson 


Number of Heads 
appeared 


Axiomatic Definition of 
Probability: 


For a given event will be probability of if 
1) for any event 

2) and 

3) If then. 


Subjective or Personalistic 

Definition: 

> Subjective probability refers to the probability of 
something happening based on an individual's 
own experience or personal judgment. 

> A subjective probability is not based on market 
data or historical information and differs from 
person to person. 


>In other words, it is created from the opinion of 
an individual and is not based on fact. 


Example: 


*An individual is asked the probability of a dice roll 
yielding a 6. The individual looks at the past three rolls 
and notes that 6 came up in all instances. The individual 
believes that the probability of the next dice roll yielding 
a 6 is at 30%. Although the mathematical prediction is 
Incorrect (the probability is 16.67%), the individual’s 
personal experience of the dice roll yielding 6 in three 
instances created a situation where he used subjective 
probability. 


Example: 


If a card is drawn from a deck of 52 playing cards, find the 
probability that the card is (i) red card (ii) the card is a 
diamond (iii) the-card is a 10 


Solution: Here 
(i) Let be the.event representing a red card then 


(ii) Let be the event representing a diamond card then 


(iii) Let be the event representing a 10, then 


Example: 


Two dice are thrown. What is the probability of getting (i) a 
double six (ii) a sum of 8 or more dots? 


Solution: The sample space in this case will be: 


(i) Let be the event having double six then 


(ii) Let be the event that a sum is 8 or more dots, then 


Example: 


Six white balls and four black e 
ball are taken from the bag, wi 
their being three yA balls? 


> CUL CD | » 4 


Example: 


An employer wishes to hire three people from a group of 15 
applicants, 8 men and 7 women. If he selects 3 person at 
random. What is the probability that (i) all are men (il) at least 
on will be woman? 


Solution: Here 
(i) Let represent the event that contain 3 men then 


(ii) Let be the event representing at least one woman then 


Example: 

Four items are taken at random from a box of 12 items and is 
inspected. The box is rejected if more than one item is found 
to be faulty. If there are three faulty items in the box, find the 
probability that the box is accepted. 


Solution: Let be the sample space then 


To find probability of accepting the box is equal to find 
probability of at the most one faulty item. Let be the event 
then 


Laws of Probability 


l- for 

Proof: Since . 

2- Law of Complementation: If and is the complement 
of then 


Proof: Since and so using third axiom of probability 
definition we have 


Conti... 


e |f a coin is tossed times and probability of head in a single trial is 
Then prob of at least one tail will be 


Example 6.11: A coin is biased so that the probability that it falls 
Showing tails is 


(a)What is the probability of getting at least one head, when a 
coin is tossed 5 times. 


(b)How many times the coin must be tossed so that the probability 
of getting at least one head Is greater than 0.98? 


Solution: Here 
(c)Let the coin be tossed times and 


So the coin should be tossed at least 14 times. 


Cont. 


3. If then 
Proof: Note that and are mutually exclusive events and 


© 


Addition Law 


4. If 
Proof: Since 


Dividing by 


lf and are mutually exclusive, then 


Example 6.12 
If a card is drawn from a deck of 52 card. What is 
the probability that the card drawn is a club card 
or face card? 
Solution: Let and be the events representing 
club cards and face cards respectively. Since 


We need to find , which is given by 


Example: 


An integer is chosen at random from the first 200 positive 
integers. What is the probability that the integer chosen is 
divisible by 6 or 8? 


Solution: Let be the sample space then 
Let be the event that an integer chosen is divisible by 6, then 


Let be the event that an integer chosen is divisible by 8, then 


will represent those integers, which are divisible by both 6 and 
8, SO 


Example 


Two natural events can result in the failure of a dam 
in an earthquake-prone area. Firstly, a very high 
flood, exceeding the design capability of its 
spillway, say, event A, may destroy it. Secondly, a 
destructive earthquake can cause a structural 
collapse, say, event B. Hydrological and 
seismological consultants estimate that the 
probability measures characterizing flood 
exceedance and earthquake occurrence on a yearly 
basis are , respectively. The occurrence of one or 
both events can result in the failure of the dam. 
What is the probability of failure of the dam? 


Solution 
Using formula: 
Only the first two probabilities on the right are 
known. However, the engineer can assume that 
the joint event has an extremely low probability, 
SO 


If one takes, for example, values of a and b for 
small dams in seismic areas as 0.02 and 0.01, 
respectively, 


This indicates a probabilitv of not more than 3% 


Example: 

Three horses and are ina race. is twice as likely to win as 
and is twice as likely to win as . What is the probability that 
or wins? 

Solution: Let, then, 

lt must be noted that all the events and are mutually 
exhaustive so 


Now 


Theorem 6.6 


e This can be proved by taking and applying addition law. 
e See theorem 6.6 in Sher Muhammad Book. 


e This is the probability of at least one of the events 
happening 


Example 
A card is drawn from a deck of 52 cards, what is the 
probability that the card drawn is a Heart, Face or King card? 


Solution: Let and be the events representing Hearts, Faces 
and Kings cards. 


Required: 


Conditional Probability: 


e Example 6.17. Two coins are tossed. What is the conditional 
probability that two heads result, given that there is at least 
one head ? 


e Solution: 


| Example 6.19 What is the probability that a randomly selected poker hand, contains. s exactly 3 


ren that it contains at least 2 aces? 
Let A represent the event that exactly 3 aces are selected and A, event that at feast 2 aces are , 
Ke 


Then we need P(A/B). 
5 4 i s d 4 i ' i - A ca ‘ 52) : Par d 
Šace a poker hand consists of 5 cards, therefore the Gy ‘space § contains | mS 2.598.960 

- -= - z = = i zi i 


x (ee 


= least 2 aces means 2 0 Sr races; and 


then 


P(B) 


(eye ee 


CD 4,542 


— 2 


~ 108, 336. 


a-b) neies: DNA B)E ca 


Theorem 6.7 Multi catlon Law: If A and B are any two events defined in a sample : 
4 


P(AMB)= P(A) P(BIA), provided P(A) #0, 


= P(B) P(A/B), provided: P(B) +0, 


TE 


lary. This rule may be extended to several events. In case of three events A, B and C, we have 
P(ANBNC)=P(DNC), were D= ANB 

= P(D) P(C/D) 

= P(ANB) P(C/AnND) 

= P(A) P(B/ A) P(CIANB); 


S:milarly, for more than three events, the formula may be proved by @rathematical induction, 
Example 6.20 A box contains 15 items, 4 of which are defi (Re and 11 are good. Two items are 
= What is the probability that the first is good and the a 

Tet A represent the event that the first item selected is git Pand Z, the event that the second item is 


Pe AS 


Then we need to calculate the probabil of the joint event AmB by the rule 


-3)= P(A). P(B/ A). 9 
, n O 
Sow P(A)= — ED 
15 \S : | 
Geven the event A has aie eee 14 items of which 4 are defective. Therefore the 
bey of selecting a detecti a good has been selected, ie. P(B/ A) Aa 
| | ah ee oe Ad 
Sare P(A B) = PUA). P(B LA)=—X— === 0.16: 


Example: 6.21 


e Two cards are dealt from a deck. What is the probability that 
second card is heart: 

Solution: We have two possibilities in this case... 1) First card 

is heart and second is heart 2) First is not heart and second 

heart. 


Example: 6.22 


* Box A contains 5 green and 7 red balls. Box B contains 3 
green, 3 red and 6 yellow balls. A box is selected at 
random, and a ball is drawn at random from it. What is 
the probability that the ball drawn is green? 


e Solution: 


There are two possibilities : A is selected and green ball 
is drawn or B is selected and green ball is drawn: 


Example 6.23 


An urn contains 10 white and 3 black balls. Another urn 
contains 3 white and 5 black balls. Two balls are transferred 
from first urn and placed in the second and then one ball is 
drawn from the later. What Is the probability that it is a 
white ball? 


e Two ball are drawn from A and placed in B. Possibilities 
are: 


1) A: 2 black balls are transferred 2) B: 1 black and 1 
white 


3) C: 2 white 


Example 6.25 Three urns of the same appearance are given as follows: 
Urn 4 contains 5 red and 7 white balls. 
Urn £ contains 4 red and 3 white balls. 
Urn C contains 3 red and 4 white balls. 
An urn is selected at random and a ball is drawn from the urn. 
i) What is the probability that the ball drawn is red? 
ii) [Ifthe ball drawn is red, what is probability that it came from urn A? 
i) Nowthe pre&bility of drawing a red ball is given by the relation 
P(R) = P(A) P(RI A) + P(B) P(R/ B) + P(C) P(R/C) 


as there are three mutually exclusive paths leading to the drawing of a red ball. 


Hence PUR) = patat 2 
Gh ae T 
atone aes 
252 


Ss PE 


ii): Here we need the probability that um LA; is selected, given that the ball drawn t+ 
P(4! R). 
By definition, P(A/ R) = AKAR) ORJA 


P(R) 


P(A R); = Probability that urn A is selected and a red ball is drawn 


Hence P oe 
ence CAM 1197252 


= în 0 
119 


7 INDEPENDENT AND DEPENDENT EVENTS | l 


Two events A and & in the same sample space S, are defined to be independent (or statistically 
endent) if the probability that one event occurs, is not affected by whether the other event has or has 


il 


oe occurred, that is 
P(A/B)=P(A) and P(B/A)=P(B). 

Sen follows that two events A and B are independent if and only if 
P(A nB) = P(A) P(B) | a 


Example 6.26 Two events A and B are such that P(A) =- .P(A/ B)=—, and P(B/4)= 


i) Are A and B independent events? 
ii) Are A and B mutually exclusive events? 
iii) Find P(A 8B) and P(B). 


i) IFA and2 are independent events, then P(A/B)=P(A) 
Now | Pi A) = ; and P(A/B) => ie. P(AIB) # P(A) 
Hence A and B are not independent events. 

ii) IFA and B are mutually exclusive events, then P(A/ B)=0. 
But it is given that P(A/B) => 
Hence A and B are not mutually exclusive sven ts. 


iii) Now P(ANB)= P(A) P(B/A) 


le La li 
43.6 
By definition, we have 
P(B) P(A/B) = P(A) P(B/ A) RX 


ee Jom bg i 


* See Examples 6.27 and 6.28 from Sher 
V C book. 


Theorem 6.9 If A and B are two independent events in a sample space S, then (i) A and 
independent, (ii) A and B are independent, and (iii) A and B are independent, 
Proof. (i) The events AMB and "A nB are mutually exclusive and their union is = 
A=(ANB)U(ANB). : 
Therefore P(A)=P(ANB)+P(A NB) = o : = - 
or P(ANB)=P(A)—P(ANB) Ss 
= P(A)—P(A)P(B) [e A and B @erndependent ] 
= P(A) U=P(B)]= PCA) 


Hence A are B are independent. 
(ii) Similarly, 


P(B) = es A) 
or P(BO A) = = PABBA 

eo) - P(B) P(A) [~ A and Bare independent | _ 
NOs P(B) [I= P(A)] = P(B) PCA) 


“Therefore A and B are independent. 


(iii) Using De Morgan's law, A ^B = AUB, we have 
P(A n B)= P(AUB) 
= 1- P(AU B) 
=1-P(4)-P(8)+ P(4AN B) 
=1— P(4)- P(B)+ P(A) P(B) 
= [1- P(A)]{1—P(B)] = P(A) P(E) 


which shows that A and B are independent. 


Example 6.29 Two cards are drawn from a well-shuffled ordinary deck of 52 cards. Find the 
Sility that ae are both aces if the first card is HO, replaced, (ii) not replaced. | 


| (P.U., B.A./B.Sc., 1967; M.A. Econ. 1969) 
Let A denote the event ace on first draw and B denote the event ace on the second draw. 
) Incase of replacement, event A and B are independent. | i 
Thus  P(both cards are aces) = P(A n B) = P(A) P(B) 
Lare ayala 
52 52. 169. 
© Ifthe first card is not replaced, the A and B are dependent events and therefore 
P(both cards are aces) = P(first ç card 1 is an ace) x P(second card is an ace given that the first 
‘card is an ace) | 


je, P(UANB)= a PU PU eee 


65255132211 © 


Example 631 The probability that a man will be alive in 25 years is 3/5, and the probability d. 
his wife will be alive in 25 years is 2/3. Find the probability that (i) both will be alive, (ii) only the m 
will be alive, (iii) only the wife will be alive, (iv) at least one will be alive and (v) neither will be alive 
25 years. (P.U., B.A./B.Sc. 197 


Let A be the event that the man will be alive and B be the event that his wife will be alive in. 
years. Then 


PUA) ==, and P(B) ==. 


i) We need the probability that Yoth will be alive, i.e. P(A B). 
Since A and B are dependis therefore: | bee, 


P(4nB)= P(A). P(B)==x x 


ii) We need the probabil ity that only the man will be alive, ie, P(An B). 


Since A and B are independent and P(B)=1-P(8). ne 
cS 


P(AnB)= P(A) B1- y 


aj 


iv) 


v) 


We require the probability that only the wig be alive, i.e. P(A nB). Thus 


mS 


P(A n8)= P(A) P(B)= SS as the event A and B- are ie le 
=1-—P(4). 
P(A) =1~ P(A) D 


We require the probabili at least one will be alive, ie. P(AUB). 


Since the events A aad) are independent and not mutually exclusive, therefore 
Ss P(AUB)= P(4)+ P(8)- P(A B) 


We need the probability that neither will be alive, i.e. P(A ^B). 
Since A and B are independent, therefore 
P(A (1B) = P(A) P(B) 
=[1- P(A)] [1- PCB) 


_~ Theorem 6.11 Bayes’ theorem. If the events A, Az,- A; form a partition of sample space Î | 
A that is, the events A, are mutually exclusive and their union is S, and if Bis any other event of S such the | 
it can occur only ifone of the A, occurs, then for any i, 


E- 


PA: )P(B/A,) 
SP4opa74) 


$$$ es 


. fori=1, 2, ..., k. 


P(A; / B) = 


SS ——D———— 


Proof: By the multiplicative law of probabilities, we have 
P(BO A;) = P(B)P(4,/8) 
= P(A) PUB! A;) 
Equating the equivalent relations of P(B ^ A;) and solving for P(A; / BY, we get 
P(A, B)=— G0 PBIA) 
P(B) 


We may write the event Bas B=SM8 (sec the Venn 
diagram) 


=(4, UA, U..UA, JAB 5 


=(4,9 8)U (4A; OB)... (A, 18), wy 


where the’ 4, B are also mutually exclusi Ne x B is shaded 
Therefore P(B) = P(4, n B)+ “eh B)+...+ P(A, N B) 


Using the multiplicative ae of probabilities, we may express each term P(4,c3 
P(4,) P(B/ 4;). Then ese 


PE) A ALY (Az) P(8/ 43) + ..3 P(A, )P(B/ A, ) 


= DAA) P(BLA;) 


i=] 


This result is generally known as the theorem on total probability. Replacing P(B) by & 
probability formula for the event B, we obtain Bayes’ formula as 


PA)P(BIA ) 
SPA )P(B! A) 


i=] 


P(4,/B) = 


Example 6.34 In a boli factory, machines A, B and C manufacture 25, 35 and 40 percent of the 
= at random and found to be defective. What is the probability that the bolt came from machine A? 
=0.25, P(B) = 0,35, and P(C)=0.40. 
Tat E represent thetyent that a bolt is defective (D). 
Teen the conditional probabilities are 7 
P(E} A) =0.05, P(E/B)=0.04, and P(E/C)=0.02. 


= outcomes with their respective probabilities may be shown byAtree diagram as below: 
Cai 


Eput, respectively, Of their outputs, 5, 4, 2 percent, respectively, are defective bolts. 4 bolt 15 


Tbe a priori probabilities (before the information that the bolt is defective) are 


Li 


2) is the a posteriori probability that the selected defective bolt, < came from machine A, 
= Bayes’ theorem, We get 
2) = P(A), PEI A) 
P(A) P(E/A) + P(B).P(E/B)+ P(C).P(E/C) 
-(0.25)(0.05) 
~ (0. 25)(0.05) + (0. 35)(0. 04) + (0, 40) (0.02) 


ha 
> > 
Success will not come 


TOMORROW unless you 
Start TODAY... 


